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RACIAL  BUS  IN  PEER  RATINGS  AT  ROTC  ADVANCED  SUMMER  CAMP,  FORT  BRAGG,  1975 


SUMMARY 


Black  and  wlilte  ROTC  cadets  attending  suraner  canm  taade  positive  and 
negative  leader  preference  ratings.  Marked  biasea  occurred  based  on  race 
of  rater  and  ratee,  especially  for  black  cadets.  Black  raters  systematic- 
ally  overseiected  black  cadets  as  most  preferred  leaders  and,  consequently, 
underselected  whites  as  most  preferred  leaders.  As  a  corollary,  the  black 
rateis  underselected  blacks  as  least  preferred  leaders  and  overseiected 
whites  as  least  preferred  leaders.  White  cadets  tended  to  over.select 
whites  as  preferred  le.iders  but  did  not  discriminate  on  the  basis  of  race 
for  least  preferred  leader.  Black  cadets  were  more  biased  against  whites 
than  were  white  cadets  towards  blackj*. 
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RACIAL  BIAS  IH  PEER  RATINGS  AT  Rf^C  ADVANCED  SL’MHER  CAMP,  FOPT  BRAGG,  1975 


INTRODUCTION 


Peer  ratings*  have  a  long  tradition  of  use  in  the  mllitarv  (for  reviews, 
see  Boulger  and  Coleman,  1964;  Hollander,  1954),  These  ratings  are  assess¬ 
ment  techniques  in  which  each  member  of  a  group  evaluates  all  other  members 
of  ,hat  group  along  soist  specified  criterion.  These  evaluations  can  be  made 
in  the  form  of  ratings,  ranking,  or  nominations.  The  result  is  that  each 
group  member  obtains  some  index  of  his  success  or  failure  along  a  given 
dimension  as  perceived  by  the  other  members  of  the  peer  group. 

* 

Typically,  peer  ratings  assess  leadership  potential  or  leadership 
ability.  Operationally,  they  have  been  used  at  the  U.S.  .Milltsr"'  Academy 
{Haggerty,  1951;  Tobin  and  Macrua  1967),  at  Officer  Candidate  School  (Parrish 
and  Drucker,  1957),  and  at  Ranger  School  (Downev,  1976).  They  are  valuable 
In  selecting  for  proewtlon,  for  senior  service  college,  and  for  duty  assign¬ 
ment  (Downev,  Medland  and  Yates  1976;  Medland,  Yates,  and  Downey,  1974), 
Besides  being  predictive  of  future  performance,  these  evaluations  have 
high  interrater  reliability  (Piske,  1960;  Hollander,  1957)  and  are  valid 
(Bartlett,  1959;  Doll  and. Longo,  1962). 

Bias  may  Influence  the  rating  process,  especiall>  -n  groups  Including 
various  minority  members.  One  significant  factor  in  peer  ratings  seems 
to  be  race.  The  rater's  race  may  influence  the  allocation  of  choices  for 
high  nociinations,  especially  if  the  rater  is  black.  Most  studie-s  show  that 
the  black  ratee  has  a  higher  than  expected  chance  of  being  rcted  high  bv 
black  raters,  independent  of  behavioral  attributes  (&;ix  and  Krumboltg,  1958; 
deJung  and  Kaplan,  1962).  These  findings  are  not  unequivocal,  however, 
since  Schmidt  and  Johnson  (1971)  found  no  effects  of  race  In  peer  evalua¬ 
tions  for  a  group  of  Mack  and  white  industrial  managers  who  bed  lust 
completed  an  Intensive  human  relations  training  program. 

The  present  investigation  examines  the  effects  of  race  on  stated  prefer¬ 
ences  for  leaders.  ROTC  cadets  selected  other  cadets  they  wanted  as  leaders 
and  cadets  they  did  not  want  as  leaders.  These  positive  and  negative 
preference  ratings  were  made  during  the  1975  annual  aujwaer  camo,  a  six-week 
simulated  military  training  exercise.  Working  groups,  or  squads,  of  10  or 
11  cadets,  randomly  chosen  from  the  larger  44-Ban  rating  group,  or  platoon, 
existed  for  the  duration  of  the  camp.  It  uaa  in  these  working  groups  that 
cadets  trained  during  camn,  and  it  was  on  the  larger  platoon-sited  group 
chat  they  based  their  choices  for  leeder.  Cadets  were  randomly  assigned 
to  the  platoon  and  then  to  the  squad,  except  that  cadets  from  the  same 
institution  could  not  be  assigned  to  the  same  platoon. 


METOOD 


SAMPLE 

A  coral  of  482  tAlte  and  124  black  cadet*  nominated  others  as  most 
and  leost  preferred  leaders.  These  cadet*  comprised  14  different  platoon*- 
sized  rating  groups.  Black  cadets  comprised  approximately  20^  of  the 
entire  sample.  This  figure  ranged  from  122  to  322  in  individual  rating 
groups.  Cadets  attending  this  summer  camp  came  predominately  from  colleges 
In  the  firat  ROTC  region. 

PROCEDURES 

Pear  ratings  were  made  during  the  fifth  week  of  camp.  From  a  list 
of  all  cadets  in  the  platoon,  racers  made  positive  and  negative  preference 
choices.  The  Instructions  stated;  “Considering  all  you  know  about  each  'of 
your  fellow  cadets,  select  the  10  you  would  be  most  willing  to  serve  andtr 
if  one  person  from  your  platoon  wore  placed  In  charge  of  your  unit;  select 
the  10  cadets  you  would  be  least  willing  to  serve  under*'.  No  cadet  could 
ncnlnace  himaelf,  and  no  cadet  could  choose  the  same  cadet  for  both  po.sitive 
j-jnd  negative  preferencee 

analysis 

Frequencies  of  most  and  least  preference  ratings  were  dependent  vari¬ 
ables.  The  independenr  variables  were  race  of  the  rater  and  race  of  the 
ratee. 


R.ESUI.TS 


Figure  1  presents  the  percunt  of  positive,  or  hlgh-prefcrence ,  choices 
allocated  to  blacks  by  black  and  by  white  raters.  The  percent  of  positive 
choices  giver,  to  whites  by  black  and  by  white  raters  equals  1.00  -  P,  where 
P  equals  the  percent  of  ratings  given  to  blacks  by  the  respective  rater 
group.  These  ratings  indicate  those  cadets  that  other  cadets  preferred 
as  leaders.  Closed  circles  mark  the  expacted  percentage  of  positive  choices 
blacks  should  have  received  if  raters  ware  unbiased.  According  to  this 
equal-probability  model,  the  percent  of  blacks  preferred  should  equal  the 
percent  that  they  represented  In  each  group,  and  the  mean  expected  rating 
should  reflect  the  percent  of  blacks  over  all  rating  groups.  Deviations 
from  these  points  Indicate  rater  bias. 


*  The  authors  would  like  to  thank  Clark  Bailey  for  his  assistance  in  the 
c  llection  of  the  data.  Also,  thanks  are  due  Beatrice  Farr  and  Nora 
Klnzer  for  valuable  coaoents. 
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%  OF  RATINGS 


PLATOON  AVERAGE 


It  is  clear  from  rlKure  I  that  black  raters  consistently  preferred 
blacks  as  leadi»rs.  Ovei  ail  rating  groups  samnled,  blacks  chose  other 
blacks  as  leaders  4'^  of  the  tine,  compared  to  an  expected  rate  of  2CZ. 

On  tlu  average,  whites  chose  blacks  as  leaders  14%  of  the  tine,  compared 
to  an  expected  rate  of  20*.  Since  1.0()  -  P  indicates  th.e  percent  of  ratings 
given  white  cadets  bv  the  respective  rating  group,  it  Is  easilv  seen  that 
blacks  ch  )ae  fewer  uhUe  cadets  for  leaders  than  expected  compared  cc 

an  expected  level  of  fifiS) ,  vdiiie  whites  only  slightly  over -preferred  white 
cadets  ?.s  leaders  (86%  compared  to  a  predicted  rate  of  ‘'nr'i 


Figure  2  presents  the  percent  ot  negative,  oi  least-nsertTrec; ,  choices 
of  cadets  for  leader  allocated  to  blacks  bv  black  and  hv  white  raters. 

The  percent  of  negative  ratings  given  to  whites  hv  bl.ack  and  bv  white  raters 
equals  l.OO  -  p,  where  P  is  the  percent  of  ratings  giver,  to  Marks  bv 
the  .anprupriittc  rater  erouo.  These  ratines  Indicate  tiiose  c.adets  oth.ers 
did  not  want  as  leaders.  Closed  circles  swik  the  expected  percentace  of 
negative  choices  blacks  should  have  received  if  r.iters  were  iinpiased. 
Deviations  from  these  pvlnts  indicate  rater  bias. 


Figure  2  i  1 3  ust  r.it  ea  that  blacks  consistently  allocated  fewer  choices 
tnan  expected  to  black.s  as  least  preferred  leaders.  That  is,  rhev  infre¬ 
quently  chose  a  bl.'ick  as  soceotie  titev  would  not  want  as  their  leader. 
Across  the  groups  s/uspled,  the  average  rate  of  choosing  blacks  as  least 
preferred  leaders  w.ss  6%,  compared  to  an  expected  rate  of  20X.  The 
extent  to  which  wiilte  raters  .allocated  negative  choices  for  blacks  as 
leaders  was  close  to  the  predicted  rate,  compc  to  tlte  expected 

r.nce  of  20%.  Black  raters  chose  witites  as  least  preferred  leaders  more 
frequently  than  predicted,  comnared  to  an  c.xpected  r.ate  of  and 

white  c.sdet3  ag.sln  .approximated  the  expected  rate  of  negative  choices  for 
blacks  as  leaders,  efioo'sing  them  81%  of  the  time. 


DISClh8S10N 

The  present  results  Indicate  that  bias  Influenced  ROTC  cadets'  prefer¬ 
ences  for  ieader.s.  This  bias  was  especi.allv  marked  for  black  cadets,  vhe 
consistently  preferred  other  blacks  as  their  icitders.  While  white  cadets 
al.so  tended  to  prefer  s.sae-race  cadet.q  .as  their  leaders,  it  was  tc  a 
lesser  extent. 

These  results  support  previous  work  showing  bia.s  in  peer  ratings  a« 
a  function  of  race  (Cox  and  Krumbolts,  1958;  de.hinp  and  Kanlan,  1962)  and 
extends  those  finding.s  in  one  important  way.  Whereas  previous  work  Involved 
assessment  of  leadership  potential,  the  current  work  dealt  with  designating 
leader  preference.  Cadets  selected  other  cadets  based  on  Instrtictlor.s 
emphasizing  personal  preferences  in  leader  selection  (l.e,,  "...who  yon 
would  be  moat  willing  to  serve  under..."),  rather  than  an  evaluation  of 
leader.shlp  potential.  Conceptually,  preference  and  potential  are  ir.denen- 
dent  dimensions.  However,  under  certain  conditions,  these  dimensions  may 
be  correlated.  Assuming  normal  distributions  for  both  preference  and 
potential,  rating  criteria  mav  overlap.  In  other  words,  there  are  some 


circumstances  under  which  a  rater  may  prefer  as  a  leader  one  who  also 
displays  great  potential.  Conversely,  under  some  circumstances,  a 
preferred  leader  may  not  be  rated  high  on  leadership  potential. 

These  findings  are  preliminary.  Currently,  ocher  research  into 
pos.sible  bias  of  peer  ratings  Is  under  way.  However,  present  results 
indicating  bias  In  racially  heterogeneous  groups  calls  into  question  the 
validity  and  reliability  of  peer  ratings  as  assessment  techniques  in  such 
groups.  That  peer  ratings  are  valid  and  reliable  for  white  males  has  been 
amply  demonstrated  in  previous  work  (e.g.,  Bartlett,  1959;  Doll  and  Longo, 
1962;  Flske,  I960:  Hollander,  1957).  Thess  Issues  must  now  be  emolrlcally 
addressed  in  racially  mixed  groups  as  well. 
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